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Abstract Body 



Background / Context: 

Spanish speakers comprise 80% of the English language learners (ELLs) in U.S. schools, and 
many of these children are considered at risk for academic failure, largely due to low levels of 
literacy achievement (August & Shanahan, 2006). In order to address this problem, we must be 
able to identify potential reading problems early so that effective, focused intervention can be 
provided. Previous research has identified phonological awareness, print knowledge, and 
orthographic knowledge as robust predictors of later reading achievement for both native English 
speakers and EEEs (Scarborough, 1998; Chiappe, Siegel, & Wade -Woolley, 2002; Eesaux, 

Koda, Siegel, & Shanahan, 2006). However, much of the research on EEE literacy development 
has looked at EEEs as a group, without investigating whether there is within-group heterogeneity 
that affects literacy outcomes. Recent research (Burrow, Cabell, Konold, & Invernizzi, 2010) on 
Spanish-speaking EEEs, however, has shown that not all EEEs represent one homogenous group 
in terms of early literacy profiles. Using cluster analysis (Aldenderfer & Blashfield, 1985), 
Burrow et al. demonstrated that Spanish-speaking EEEs in the fall of kindergarten represented a 
heterogeneous group that could be classified into four distinct clusters using three broad 
measures of early literacy abilities: phonological awareness, orthographic awareness, and 
alphabet knowledge. The four cluster profiles were described as: 1) the highest early literacy 
group (i.e., high performing across all literacy domains), 2) the average phonological and 
orthographic awareness with high alphabet knowledge group, 3) the average phonological 
awareness with low alphabet and orthographic awareness group, and 4) the lowest literacy group 
(i.e., low performing across all literacy domains). 

Purpose / Objective / Research Question / Focus of Study: 

hollowing a cohort of students from fall of kindergarten to spring of first grade, we investigated 
whether the general cluster profiles identified in Burrow et al.’s (2010) study remained consistent 
over time. If cluster profiles in the fall of kindergarten held, our goal was to investigate the 
differences between clusters in terms of their instructional reading levels at the end of the first 
grade. Because we could expect that the highest literacy cluster would remain significantly 
higher at the end of the first grade given that early literacy predicts achievement in succeeding 
grades (Juel, 1988), we investigated the performance of the other three lower performing groups. 

We had two research questions: 

1) Would research-based cluster profile patterns remain consistent with the current dataset 
used (i.e., were the clusters generated similar in characteristics based on early literacy 
skills)? 

2) If clusters profiles were consistent, how would the three lower ranked clusters perform 
based on their instructional reading levels at the end of first grade, while controlling for 
other student-level variables? 

Setting: 

The study involved the secondary data analyses from restricted-use datasets from a Mid-Atlantic 
state. 
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Population / Participants / Subjects: 

A cohort of 1,424 students (49% female, 51% male) from 271 public schools in a Mid- Atlantic 
state was followed from kindergarten (fall 2008) through the end of first grade (spring 2010). All 
of the students were identified by their sehools as Hispanic and spoke Spanish at home. Mean 
age of the participants in the fall of kindergarten was 69 months, and 81% of the participants 
were classified as eeonomieally disadvantaged using the free and reduced price luneh (FRPL) 
eligibility status. In kindergarten, 96% had no diagnosed disability (i.e., intelleetual disabilities, 
speech/language impairment, developmental delay), and 61% were receiving English as a 
Second Language services (ESL). By the spring of first grade, 93% of participants had no 
diagnosed disabilities, and 68% were receiving ESL serviees. Student deseriptive characteristics 
are presented in Table 1 . [insert table 1 about here] 

Intervention / Program / Practice: 

All participants were administered, by their elassroom teaehers, the Phonologieal Awareness 
Literaey Screening (PALS) assessment in kindergarten and in first grade. PALS for 
kindergarteners (PALS K; Invemizzi, Juel, Swank, Meier, 2003) and PALS for grades one 
through three (PALS 1-3; Invemizzi, Meier, & Juel, 2003) were designed to identify students 
who are below grade-level expectations in important literacy fundamentals and identifies 
students who are at risk of reading diffieulties and delays (Invemizzi, Justiee, Landmm, & 
Booker, 2004). PALS is a eriterion-refereneed assessment administered by the teacher. Some 
tasks are administered individually, and others are administered in small groups (i.e., five or 
fewer ehildren). 

The tasks we examined in the fall of kindergarten were: 

Rhyme awareness. The rhyme awareness task is administered to a group of five or fewer 
students. Students are shown a series of four pictures of high-frequency words appropriate for 
kindergartners. All are single-syllable words that can represented pictorially (e.g., tire, book, pot, 
fire). The names of all the pictures are read aloud by the teacher and students are asked to eircle 
the pieture that rhymes with the first picture in the series (i.e., tire, fire). There are ten sets of 
pictures and students can score a maximum of 10 points, one per set of pictures. 

Beginning Sound Awareness. In the beginning sound awareness task, students are shown another 
series of four pictures of high-frequency words appropriate for kindergartners (e.g., fish, mop, 
bell, fenee). The names of all the pictures are read aloud by the teaeher and students are asked to 
circle the pieture that has the same beginning sound (i.e., fence) as the first pieture in the series 
(i.e., fish). There are ten sets of pictures and students ean score a maximum of 10 points, one per 
set of pietures. 

Alphabet reeognition. In the alphabet recognition task, students are individually shown 26 
randomly ordered, lowerease letters and are asked to point to and name each letter. Only 
lowerease letters are used since lower-case letter reeognition is highly correlated with upper-case 
letter recognition (r=.94 in kindergarten), and there is no eeiling effect when lower-ease letters 
are used (Invemizzi, Juel, & Meier, 2003-2009). Students can score a maximum of 26 points. 
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Letter sound knowledge. Children are individually shown 23 upperease letters and three digraphs 
(eh, th, and sh). (Beeause the letters Q and X eannot be pronouneed in isolation, they are not 
ineluded. The letter M is used as a praetiee item). Students are asked to toueh eaeh letter on the 
page and say the sound it represents (e.g., S makes /s/). Only the short vowel sound for eaeh 
vowel is scored as correct and only the hard sounds for C and G are scored as correct. A total of 
26 points is possible. 

Invented spelling. The spelling task can be administered to groups of five children or fewer. The 
task was designed to assess student performance on the representation of beginning, middle, and 
ending speech sounds. Children are asked to write or attempt to write a series of five high- 
frequency, single-syllable, consonant-vowel-consonant (CVC) words (e.g., fan, pet), which the 
teacher reads aloud, one at a time. The child receives points for providing a phonetically correct 
representation for each sound in the word, with an additional point awarded for spelling the word 
correctly. Students can score a maximum of 20 points on the task. 

In the spring of first grade, students were administered PALS 1-3 which consisted of a different 
set of task from PALS-K. The main outcome of interest for our study was the instructional oral 
reading level (M=L46, SD=\.\2, min=0, max=6) of the child, which was determined by 
combined performance on the PALS 1-3 Word Reading in Isolation and Oral Reading in Context 
tasks. Instructional oral reading level was calculated as the highest level at which a student can 
accurately read at least 75% of the words on the Word Recognition in Isolation list and 90% to 
97% (85% to 97% at the Readiness or Preprimer level) of the words on the Oral Reading in 
Context passage. The oral reading levels addressed in this study were Readiness, Preprimer A, 
Preprimer B, Preprimer C, Primer, and first through sixth grades. Beginning at first grade, a one- 
point increment represents one grade level in reading. 

The tasks we examined in the spring of first grade were: 

Word Recognition in Isolation. The Word Recognition in Isolation task consists of eight graded 
word lists (Preprimer through sixth grade). The student begins by reading the list that 
corresponds to the benchmark for his or her assigned grade level and then moves up or down to 
determine the highest list which can be read with 75% accuracy. 

Oral Reading in Context. For this task, the student reads a minimum of three graded passages: 
the passage that corresponds to the highest word list read with 75% accuracy, the one above, and 
the one below. 

Research Design: 

Our research consisted of secondary data analyses. 

Data Collection and Analysis: 

The data for the present study come from merging two state-provided restricted-use datasets that 
could be used to track early literacy outcomes using PALS scores. We narrowed down our 
sample based on only those students who were identified as Hispanic and spoke Spanish at home 
as their primary language. 
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We had two main steps in our analyses: the first was to perform eluster analyses on our 
partieipants in kindergarten to ereate the student eluster groupings. The seeond was to eompare 
the three of the four identified elusters to investigate their instruetional reading levels at the end 
of first grade using multilevel modeling. 

Clustering strategy 

We used five measures of early literaey from the PALS-K to form our elusters: two measures of 
phonologieal awareness (a) beginning sound awareness and (b) rhyme awareness; two measures 
of alphabet knowledge: (a) letter name reeognition and (b) letter sound reeognition; and one 
measure of orthographie knowledge (a) invented spelling. Beeause the measures were on 
different seales, all measures were eonverted to T-soores with a mean of 50 and a standard 
deviation of 10, as reeommended by several researehers (e.g., Aldenderfer & Blashfield, 1985; 
MeDermott, 1998). Standardization was done so the different measures eontribute equally to the 
similarities among subjeets (Romesburg, 1986). A hierarehieal-agglomerative elustering 
proeedure using Ward’s (1963) method was employed using SAS PROC CLUSTER. Sinee 
there are no eompletely satisfaetory methods for determining the number of population elusters 
(i.e., there is no test of a null hypothesis) for any type of eluster analysis (Boek 1985; Everitt 
1979), we determined the number of elusters by examining the eut points in the resulting 
dendogram (i.e., tree diagram), as was done by Peek (2005), who had a similar goal of ereating 
eomparison subgroups that were readily interpretable. We also used a more formal, but still 
heuristie, method of using the fusion or amalgamation eoeffieients produeed in the tree diagram 
(Aldenderfer & Blashfield, 1985), and the method is similar to using a “seree plot” in order to 
determine the number of faetors to retain in faetor analysis (Overall & Magee, 1992). 

After generating the elusters, we deseribed the eluster eharaeteristies based on variables not used 
to generate the eluster groupings: age in months, eeonomie status, whether the ehild was 
disabled, and whether the ehild was reeeiving ESE serviees. 

Modeling strategy 

We modeled the students’ instruetional reading level at the end of the first grade (our dependent 
variable) on the students identified eluster (our independent variable), while holding other 
student level variables eonstant (i.e., age in months, disability status, reeeiving ESE serviees, and 
eeonomie disadvantage). Cluster levels were dummy eoded with eluster 3 being the referenee 
group. Age in months, our only eontinuous eovariate, was grand mean eentered. We used two- 
level multilevel modeling (Luke, 2004; Raudenbush & Bryk, 2002) using SAS PROC MIXED to 
generate the appropriate standard errors to aeeount for the students nested in schools. As the 
clusters, and not the schools, were our primary area of interest, we did not include school-level 
covariates. 

Findings / Results: 

Results of the cluster analysis revealed four distinct cluster profiles. The cluster profiles are 
presented in Eigure 1. The cluster profiles mirrored the pattern of early literacy skills found in 
the Burrow et al. (2010) study, despite using data from another time period. One difference, 
however, is that our cluster 2 had above average phonological awareness skills (+.25 SD) as 
compared to the average phonological awareness level in cluster 2 in the Burrow et al. study. The 
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descriptive profiles of each of the clusters are presented in Table 2. [insert figure 1 and table 2 
about here] 

In the reduced sample (excluding cluster 1), the reading level mean was 1.29 (5D=1), indicating 
that by the end of first grade, our participants were reading slightly above grade level. Table 3 
shows results from the full multilevel modeling analyses that used reading level as the outcome 
variable, using clusters 2 through 4 as our independent variable. 

Findings of the multilevel modeling results revealed that differences in reading levels between 
cluster 3 and cluster 4 were not statistically significant, despite cluster 3 having higher 
phonological awareness skills in fall of kindergarten. In the two lowest performing groups there 
were no statistically significant differences in alphabet recognition, letter sounds, or invented 
spelling in the fall of kindergarten. The inclusion of the independent variable and the covariates 
accounted for approximately 15% of the overall variance, [insert table 2 about here] 

Cluster 2, on the other hand, had significantly higher reading levels compared to the other two 
groups. The difference in reading level between cluster 2 and the two lower clusters amounted to 
an average of 2/3 of a grade level (b=.65). 

Conclusions: 

Our findings support earlier research (Burrow et ah, 2010) that demonstrated heterogeneity 
among Spanish-speaking ELLs in kindergarten. Further, we found that the same clusters that 
were identified in the Burrow et al. study remained consistent in our sample, even though we 
used data from another time period. When we examined reading level for the lower three clusters 
in our sample, we found that clusters 3 and 4, the two lowest clusters, were achieving at 
approximately the same level in reading at the end of first grade, while the mean reading level 
for cluster 2 was approximately 2/3 of a grade level higher. 

What distinguished cluster 2 from the other two clusters was higher performance on print-related 
tasks in fall of kindergarten. Although both cluster 2 and cluster 3 had average or above-average 
phonological awareness in fall of kindergarten, cluster 2 performed significantly better in 
alphabet knowledge and orthographic knowledge, the two domains made up of print-related 
skills (i.e., letter name and letter sound knowledge, spelling). This finding is consistent with 
previous research (Hammill, 2004; Scarborough, 1998) identifying written language skills as the 
most accurate predictors of later reading achievement, once children have begun formal literacy 
instruction. 

These findings have clear implications for literacy screening and instruction for Spanish- 
speaking ELLs. Early literacy screening instruments must include measures of alphabet 
knowledge and orthographic knowledge in order to best identify children at risk for developing 
reading problems (Scarborough, 1998). In addition, early literacy instruction should focus on 
print-related skills in order to ensure that ELLs are well-prepared for the task of learning to read 
(Hammill, 2004). 
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Appendix B, Tables and Figures 



Table 1 



Participant (n= 1,424) descriptive statistics in kindergarten: fall (in 271 schools) 



Characteristics 


n 


% 


M 


SD 


Gender 










Male 


723 


51 






Female 


701 


49 






Students with disabilities 


57 


4 






Students receiving ESL services 


864 


61 






Economically disadvantaged 


1,151 


81 






Age (in months) 






69.17 


4.57 
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Table 2 



Descriptive profiles of clusters in spring of first grade 





Cluster 1 
n=220 


Cluster 2 
n=427 


Cluster 3 
n=365 


Cluster 4 
n=412 


Characteristic 


(15%) 


(30%) 


(26%) 


(29%) 


Female 


0.55 


0.52 


0.50 


0.44 


Economically disadvantaged 


0.75 


0.81 


0.82 


0.82 


Disabled 


0.04 


0.05 


0.07 


0.10 


Receiving ESL services 


0.46 


0.64 


0.76 


0.78 


Age in months 


88.74 


87.42 


86.85 


86.42 


Reading level 


2.40 


1.76 


1.06 


1.01 
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Table 3 



Unconditional and full multilevel models using reading level 
(n= 1,204) 


as the dependent variable 






Unconditional model 


Eull model 




Variable 


Estimate SE 


Estimate 


SE 


Intercept 


1.32 *** 0.04 


1 42 *** 


0.09 


Cluster 2“ 




0.65 *** 


0.07 


Cluster 




-0.05 


0.07 


Eemale (l=yes) 




-0.08 


0.05 


Economically disadvantaged 
(l=yes) 




-0.06 


0.07 


Classified with disability (l=yes) 




-0 42 *** 


0.10 


Receiving ESE services (l=yes) 




-0.30 *** 


0.06 


Age in months 




-0.02 *** 


0.01 


Variance components 


Student level 


0.93 *** 0.03 


Q yg *** 


0.03 


School level 


0.07 ** 0.04 


0.07 ** 


0.02 



Note. SE=Standard errors; ESL=English as a Seeond Eanguage 
^ Cluster 3 is the reference group. 

**/><. 01 , ***/><. 001 . 
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Figure 1 

Cluster profile descriptions based on five early literacy skills (scores are r-scores, M=50, 
50=10) 
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